The entropy functional, the information path functional's essentials and their connections to Kolmogorov's entropy, complexity and physics
نویسنده
چکیده
Introduction The entropy functional, defined on a Markov diffusion process, plays an important roll in theory of information and statistical physics [1-3], informational macrodynamics and control systems [4]. However in the known references, we did not find the mathematical results related to the entropy functional’s connections with the Kolmogorov’s entropy, complexity, and the Lyapunov’s characteristics [5]. We analyze these connections through the information path functional (IPF) of controllable diffusion process, considering the IPF’s essentials and specifics, including the singularities of the IPF extremal equations and the created invariant relations. The paper is a part of the information path functional approach [6-8] in solving the problems of information evolutionary dynamics. Searching a law, which governs complex dynamics of interacting process, leads us to the process’ statistical dynamics first, and then to finding a variation principle that, according to R. Feynman (The character of physical law), might describe regularities of such dynamics, possibly at a macroscopic level. Sec.1 introduces the entropy functional expressed via an additive functional of controllable diffusion process and the parameters of corresponding stochastic equation, applied to the IPF variation problem. Sec.2. presents an essence of the IPF approach, considering both the problem statement and its formalization for a class of random systems, modeled by the solutions of controlled Ito’s stochastic differential equations; defines a probabilistic measure of the functional’s distance between a current process’ trajectory and some given process; applies the entropy functional, defined on these solutionstrajectories, and presents the dynamic approximation of both this probabilistic measure and the conditional entropy functional by the corresponding path functionals. We illustrate a specific of the formulated variation problem’s solution using both the Kolmogorov (K) eqs. for the functional of a Markov process and the Jacobi-Hamilton (J-H) eq. for the dynamic approximation of this functional as the IPF. Because the fulfillment of both J-H and K equations in the same field’s region of a space is possible at some “punched” discretely selected points (DP), the extremal trajectory, solving the variation problem (VP) is divided on the extremal’s segments at each DP. Between the extremal segments (at DP) exists a “window”, where the random information affects the dynamic process on the extremals, creating it’s piece-wise dependency upon the observed data.
منابع مشابه
Evolution of Information and Complexity in an Ever-Expanding Universe
Using the usual definitions of information and entropy in quantum gravity and statistical mechanics and the existing views about the relation between information and complexity, we examine the evolution of complexity in an ever expanding universe.
متن کاملAssessing the Effects of Alzheimer’s disease on EEG Signals Using the Entropy Measure: a Meta-Analysis
Introduction and Aims: Alzheimer’s disease is the most prevalent neurodegenerative disorder and a type of dementia. 80% of dementia in older adults is because of Alzheimer’s disease. According to multiple research articles, Alzheimer's has several changes in EEG signals such as slowing of rhythms, reduction in complexity and reduction in functional associations, and disordered functional commun...
متن کاملA multi agent method for cell formation with uncertain situation, based on information theory
This paper assumes the cell formation problem as a distributed decision network. It proposes an approach based on application and extension of information theory concepts, in order to analyze informational complexity in an agent- based system, due to interdependence between agents. Based on this approach, new quantitative concepts and definitions are proposed in order to measure the amount of t...
متن کاملTsallis Entropy and Conditional Tsallis Entropy of Fuzzy Partitions
The purpose of this study is to define the concepts of Tsallis entropy and conditional Tsallis entropy of fuzzy partitions and to obtain some results concerning this kind entropy. We show that the Tsallis entropy of fuzzy partitions has the subadditivity and concavity properties. We study this information measure under the refinement and zero mode subset relations. We check the chain rules for ...
متن کاملCasimir effects of nano objects in fluctuating scalar and electromagnetic fields: Thermodynamic investigating
Casimir entropy is an important aspect of casimir effect and at the nanoscale is visible. In this paper, we employ the path integral method to obtain a general relation for casimir entropy and internal energy of arbitrary shaped objects in the presence of two, three and four dimension scalar fields and the electromagnetic field. For this purpose, using Lagrangian and based on a perturb...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1107.1739 شماره
صفحات -
تاریخ انتشار 2010